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AMlACf j^feoctl  area  computer  network  ainulations  are  inherently  non- 
Markovian  in  that  the  underlying  stochastic  proceas  cannot  be  eodeled  as  a 
Harkov  chain  with  countable  state  space.  We  restrict  attention  to  local 
network  sinulations  with  an  underlying  stochastic  process  that  can  be  rep- 
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resented  as  a  generalised  seni-Markov  process  (GSMP).  Using  new  better 


than  used  distributional  assunptions  and  sanple  path  properties  of  the 
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S^crii 


GSMP,  we  provide  a  "geoaetrlc  trials  criterion  for  recurrence  in  this 
setting.  We  also  provide  conditions  which  ensure  that  a  GSMP  is  a  regener¬ 
ative  process  and  that  the  expected  tine  between  regeneration  points  is 


stive  process  and  that  the  expected  tine  between  regeneration  points  is 
finite.  Steady-state  estiaation  procedures  for  ring  and  bus  network  siau- 
lations  follow  froa  these  results,  a 
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Itfls  difficult  teestablish  estimation  pro— duns  for  local  im 


that  explicitly  iacdpttrate 


control  algorithms.  Such  liawktioai  tM 


e.g.,  JgMtert  and  Shelter  [8,9],  Louefcs,  Hantacher,  sad  Freiss 


are  inherently 


non-Markowlan  fcetheiense  that  the  under  lying  stochastic  proeeaa 


Meritor  duda  with  eoentefaie  state 


Following  [8]  we  restrict  attention  to  local 


underlying  stochastic  process  can  be  represented  as  a 


Although  steady-state  estimation  for  an  arbitrary  osmt  it  a  formidable  problem, 

-  -  :  •"<  .  ' ;  -  :  .  •  ...  -><■  Ss-i.:.;-  !;}S'  :r'  -  ‘  s 

estimation  procedures  [8,9]  ace  available  for  one’s  that  are  regenerative  processes.  To 
establish  the  regenerative  property  for  a  osw,  it  is  necessary  to  show  the  existence  of  an 


thnt  a 


ia  often  the 


associated  with  a  local  ana  network  simulation 


tosome  fixad 


For  specific  models,  however.  It  is  nontrivial  to  determine  conditions  (distributional 


amnunplioan)  under  whieh  ths  underlying  one  returns  infiniuly  often  to  the  fined  state. 


A  "geometric  trials"  argumant  given  In  [8]  establishes  a  recurrence  criterion  for  a 
tactic  proems  U(/):i20}  with  right -continuous  and  piscewiae  constant  sample  peths 


and  couataUa  stats  spaea,  S.  Let  (T^naO)  be  an  increasing  sequenos  of  finite  state 

transition  timaa  for  |JK(r):raO).  The  procasa  hits  state  »  c  5  infinitely  often 

‘  *;  *  •  - 

with  probability  ons  provided  that  flfirj  ■  »  |X<T||.|)^..Jf(70)}al  a.s.  for  some  8>0. 
This  geometric  trials  iccurranm  criterion  avoids  the  often  unrealistic  "positive  density" 


(a u  m 


Markov  chain 


y  ',y.'  -p  - 


b  lilt  pap**  using  aaplt  path  properties  of  the  osmf,  we  provide  conditions  which 
it  mlntin  ai  tt*  mntHe  tfbl*  ncwttei  criterion  la  th*  aarnr  setting*  Our 


apptoachiMn  poariite  ttl  anktonoo  of  »  dialfngnishsd  random  Una  In  the  interval 
EFg.t*?*)  sad-a  Ml  ol  distinguished  events  dstermioed  by  the  state  of  the  ayateat  at  tha 
iHsUngalshiil  tin*  each  that  XLTJ  -  *  if  each  of  tha  distinguished  events  occun  "toon 
enough”  bafora  time  r„.  Wa  show  that  {JRF^uiaO}  hits  stats  i  infinitely  often  with 
probability  one  If  tha  clock  setting  distributions  associated  with  the  diallafruished  events 
have  "new  better  than  used"  distributions  sad  satisfy  s  "positivity"  cooditioa.  Waslso 
provide  additional  conditions  on  the  building  Mocks  of  tbs  osmp  which  ensure  that  tha 


provide  additional  conditions  on  the  building  Mocks  of  the  osmp  which  ensure  that  tha 
successive  tines  at  which  UftT^tehO)  hits  state  a  are  regeneration  points  for  the  process 
{X(t):nO}  and  that  the  expected  time  between  regeneration  points  is  finite. 


Heuristicaliy,  a  osier  (Matthes  (13],  Kftoig,  Matthes  and  Nawrotzki  [10],  (11]) 
moves  frost  state  to  mate  in  accordance  with  the  occurrence  of  events  associated  with  the 
occupied  state.  Each  of  the  several  possible  events  associated  with  a  state  compete  to 
trigger  the  next  transition  and  each  of  these  events  has  its  own  distribution  for 
determining  the  next  state.  At  each  state  transition  of  the  gsmt,  new  events  may  be 
scheduled.  For  each  of  these  new  events,  a  clock  indicating  the  time  until  the  event  ie 
scheduled  to  occur  is  set  according  to  an  independent  (stochastic)  mechanism.  If  a 
scheduled  event  docs  not  trigger  a  transition  but  is  associated  with  the  next  state,  its 
clock  continues  to  run;  if  such  an  event  is  not  associated  with  the  next  state,  it  Is 


Following  Whitt  (id],  formal  definition  of  s  omr  is  in  urns  of  s  gsosral  mate 
i  Markov  chain  (qmmc)  which  describes  tbs  procsss  st  successive  epochs  of  state 


\m 
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Up— rittao.  Let  5  be  a  finite  or  countable  Mt  of  states  and  E  •  be  a  finite  aet 

of  nem.  For  s£S,  E(s )  denote*  the  set  of  all  events  that  can  occur  when  the  osur  is  in 
state  a.  When  the  process  is  in  state  s,  the  occurrence  of  an  event  tc  E(s)  triggers  a 
transition  to  a  state  s'.  We  denote  by  p(*;s#)  the  probability  that  the  new  state  is  s' 
given  that  event  «  triggers  a  transition  in  state  s.  For  each  ic  5  and  o£  £(s)  we  ««— 
that  f('isjt)  is  a  probability  mass  function.  The  actual  event  e€  E(s)  which  triggers  a 
transition  in  state  s  depends  on  clocks  associated  with  the  events  in  £(s)  and  the  spools  at 

•  •  •'  ’  !•  .  •  j.  •  •  a . 

which  these  clocks  run.  Bach  such  dock  records  the  remaining  time  until  the  event 
triggers  a  state  transition.  We  denote  by  *■„  (*0)  ten  deterministic  rate  at  whisk  the 
dock  Cp  associated  with  event  *f,  ram  in  state  rt  for  each  *«$,  ra  -  0  if  «^f(r).  We 
assume  that  r^X)  for  some  *,e  f(i).  (Typkaily  in  applications,  all  speeds  rM  are  equal  to 
one.  There  are,  however,  models  in  which  speeds  other  than  unity  as  well  as 
state-dependent  speeds  are  convenient.  For  example,  aero  speeds  are  needed  in  queueing 
systems  with  service  interruptions  of  the  preemptive-resume  type;  cf.  Shadier  and 
Southard  [14].) 


For  t€  S  define 


C(i)  m  |(cj,...,cjf):  c(  a  0  wad  ct  >  0  if  and  only  if  *(£  E(i); 

(2.1)  c/j+cfi  for  i+J  with  CfCjt^j  >  o|. 

Th*  conditions  In  Equation  (2.1)  ensure  that  no  two  events  simultaneously  trigger  a 
transition  (as  defined  below).  The  set  C(r)  la  the  mt  of  possible  clock  readings  in  state  s. 
The  dock  c,  and  event  ot  are  said  to  be  active  in  state  s  if  #,«£(*).  For  sc  5  and  ceCts), 


/  -m  f  M  *  mlB  {*&}, 


where  is  taken  to  be  ♦  «  when  rd  »  0.  Also  set 


(2.3) 


‘c’  -  cj(s,c)  m  et  -  iWlji  «i<  £(*) 


/  -  /'(v)  ■  A  such  that  *jC  £(i)  and  cj(t^)  -  0. 


state  «  with dock 


c,  t  M  is  thetteM  to  dw  ate  state  traiuitfon  and 


i  (rj:)  is  tbs  index  of  the  uniqac  triggering  event  *  ■  e  (v)  ■ 

At  a  transition  from  stats  i  to  state  s'  triggered  by  event  /,  new  dock  times  am 
generated  for  each  r'tJVfi'u/)  ■  E(i')*(£(iHr}).  The  distribution  function  of  such  a 
new  clock  time  is  denoted  by  F(;rJjj)  and  we  assume  that  £(0:*V  j,t)  -  0.  For 
e* c O(i’w)  -  £(i')n  (£(*)-{/}),  the  old  clock  reading  is  kept  after  the  transition.  For 
*  e  (£(«)-{**})-£(«),  event »  ceases  to  be  scheduled  after  the  transition. 


Next  consider  a  ossmc  {(SH,CJ:n*0i  having  state  space 

X  -  U  (MkCW) 

t€S 

and  representing  the  state  (£„)  and  vector  (C*)  of  clock  readings  at  successive  state 
transition  epochs.  (The  Ah  coordinate  of  the  vector  C„  is  denoted  by  C^.)  The 
transition  kernel  of  the  Markov  chain  {(5N,C„):na0}  is 


(2.3) 


*  K*'«M*)  JJ  Fim^t  fptj)  n 


A  m  {i}xJ(ci,...,c*)cC(*  ):  c)  *  a(  for  e,«£(s)). 


The  Mi  A  U  Um  subeetof  J  which  corresponds  to  the  gsmt  entering  «UU  s  with  the 
reading  c,  on  the  clock  associated  with  event  tte  E(s)  set  to  a  value  In  [0^]. 


Finally,  the  osmt  is  a  piecewise  constant  continuous  time  process  constructed  from 
the  ossmc  {(5a,Cll)uft0)  in  the  following  manner.  Set  { 0  -  0  and  denote  by  f H  the  time 
of  the  nth  state  transition,  «*0.  (We  assume  that 


Ffsupfg*  + -KS’o.C^}  -  1  a.s. 
«u 


for  afl  initial  states  (S^Cq).)  Then  set 


sm> 


W  -  me*  i«  i  0:  s  i|. 


(X(f):f  aO)  defined  by  Equation  (2.6)  la  a  osier.  We  assume  from  now  on  that 


are  equal  to  1. 


The  characteristic  property  of  a  regenerative  stochastic  process  (Smith  [IS])  is  that 
there-eslst  tandem  time  points,  referred  to  as  wpseerurtaw  points  or  rtgontrahon  tinm,  at 
which  the  process  probabilistically  restarts.  The  essence  of  regeneration  is  that  the 
evolution  of  the  process  in  a  cycle  (l.e.,  between  any  two  successive  regeneration  points) 
is  a  probabilistic  replica  of  the  process  la  any  other  cycle.  In  the  presence  of  mild 
regularity  conditions,  a  regenerative  stoshuatlc  process  {£[r):ra0}  has  a  limiting 
dfetfrfbotioo  (X(t)+X  as  /*••)  provided  that  the  expected  time  between  lagitiration 


*V  - 
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points  is  finite.  Furthermore,  the  regenerative  structure  ensures  that  the  behavior  of  the 
process  in  a  cycle  determines  the  expected  value  of  a  function  of  the  limiting  random 
variable  JIT  as  a  ratio  of  expected  values.  These  results  have  important  implications  for 
simulation  and  are  the  basis  for  the  regenerative  method  for  simulation  analysis;  see 
Crane  and  Iglehart  (3]. 

(2.7)  DEFINITION.  The  real  (possibly  vector-valued)  stochastic  process  {Jti(f):r*0}  is  a 
regenerative  process  in  continuous  time  provided  that: 

(i)  there  exists  a  sequence  of  stopping  times  {7t:it0}  such  that  [Tk+l-Tk:kiQ]  are 
independent  and  identically  distributed; 

(U)  for  every  sequence  of  times  (*ial)  and  k* 0,  the  random  vectors 

and  | X{Tk  +  Tk  ♦  /„)}  have  the  same  distribution  and  the 

processes  and  {X{Tk  +  no  independent. 

Recurrence  properties  of  the  underlying  stochastic  process  of  a  discrete -event 
simulation  are  needed  to  establish  estimation  procedures  baaed  on  regenerative 
Lemma  (2.8)  is  a  special  case  of  a  generalized  Borel-Cantelli  lemma  due  to  Doob 
(4,  p.  324];  see  [g.  Lemma  4]  for  an  elementary  proof  using  a  "geometric  trials" 
argument. 


(2.8)  LEMMA.  Let  |r.:naO}  be  a  sequence  of  random  variables  defined  on  a  probability 
space  and  taking  on  values  in  a  set,  S.  Let  j'c  S.  Suppose  that  there  exists  6X> 

such  that 

FIT.  -  t  |  Y^ . Y0)  a  t  a.s. 


for  Ml  ml.  Than  /|r.  •  s'  i.o.}  -  1. 
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Lemma  (2.t)  provides  a  means  of  Rowing  that  the  underlying  stochastic  process  of 
a  simulation  returns  infinitely  often  to  a  fined  state.  Specifically,  let  be  a 

stochastic  process  with  right-continuous  and  piecewise  constant  sample  paths  and 
qmmtablc  state  space*  &  Let  it  $  and  suppose  that  ir.maO)  is  an  increasing  sequence 
of  finite  iTm<m  a.s.)  state  transition  tfanes  for  U&)utO)  such  that 

WHTJ  a  «  a.a. 

for  some  OO.  Then  P{X(TJ  ■  a  i.o.}  •  1  by  Lemma  (2.8)  (with  Ym  ■  2(7,)). 

Using  "new  better  than  used"  distributional  assumptions  and  the  sample  path 
structure  of  the  process.  Proposition  (2.1  provides  sufficient  conditions  for  recurrence 
in  theosMP  setting. 

•'* '  V .  ■  .  -i.-  •  ■  ■  ? ' 

(2.9)  DEFINITION.  The  distribution  F  of  a  positive  random  variable  A  is  new  better  then 
used  (. NBV )  if 


for  all  v*®- 


P[A  >  x  ♦  y  \A  >  y)  a  P{A  >  x) 


See  Barlow  and  Proachan  {1]  for  a  discussion  of  NBU  distributions.  Note  that  every 
increasing  failure  rate  (IFR)  distribution  is  NBU.  Also,  if  A  and  B  are  independent 
random  vatfafttos  with  NBU  distributions,  then  the  distributions  of  A  +  B,  min  (A A), 
and  max  (AJ)  are  NBU. 


Let  {JK(0:rkO)  be  a  osmp  with  finite  state  space,  S,  and  event  set,  E.  Suppose  that 
{rM:**0}  to  an  — 1 sequence  of  finite  (rN<«  a.s.)  state  transition  times  such  that 
for  seme  r  If  and  fiJ:  r0>0  and 


(2.10)  Tm  •  inf{/  >  T^j:  at  time  t  event  *  triggers  a  transition  in  some  state  /«$*}, 


Mil. 

Let  j^cS.  Proposition  (2.11)  postulates  the  existence  of  a  distinguished  random 
time  (1^)  In  the  interval  defined  by  Equation  (2.10),  and  a  set  (£+(«+))  of 

distinguished  events  determined  by  the  state  s*  of  the  system  at  time  7*  such  that 
X{Th)  m  when  each  of  the  distinguished  events  *£(*£)  occurs  prior  to  some  time 
7*  +  *hjS*h)  (>0-  ^h*  proposition  asserts  that  {*(7'f|):ni0}  hiU  state  jJ,  infinitely 
often  with  probability  one  if  the  clock  setting  distributions  associated  with  the 
distinguished  events  are  NBU  and  satisfy  a  "positivity”  condition  which  guarantees  the 
existence  of  JX)  as  in  Lemma  (2.8). 

Let  [T%  :na 0)  be  a  sequence  of  state  transition  times  and  denote  the  state  space  of 
tf(7?):«tt0i  by  S+.  Forr+€S+,Iet 

E+(s+)  -  K(*+),...,#kV)('+)* B  £(jr+) 

and  set 

B+  -  U 

»*€S* 


When  JKCT^)  ■  we  denote  by  S^s*)  the  latest  time  less  thanor  equal  to  Tf  at  which 
the  clock  associated  with  event  e£(j+)  was  set,  and  by  the  setting  on  the  clock 

at  time 
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(2.11)  PROPOSITION.  Assume  that  there  exist  state  transition  times  {7^ :n*0}  and  for 
s+cS+  event  sets  £+(*+)  and  identically  distributed  strictly  positive  random  vectors 
(j?l».1(,+)»-*Jl«iJkCf+)(,+))*  independent  of  [Am  ,i(X(T£)),...JHjcVaT*n(XlTf))}  and 
{X(<)K)sfs7^’},  such  that: 

(i)  a.s.  and  for  x0pf1,...^tn.1  £  £  and  i+c  £+, 

P{X[Th)  -  Sq.  X{Tf)  -  s+,  X(TnA)  -  xnA,...JC{TJ  -  x0} 

*  P{SnM^  *  *  K  +  Rn*(s">'  k  *  l*2 . 

X(T^)  -  s+,  -  xJ|.1,...^T(r0)  -  *0}; 

(ii)  for  all  r+£  £+,  the  clock  setting  distribution  F(-;s  ,e+ j,e)  —  F(;e+)  and  is  NBU; 

(iii)  there  exists  «X)  such  that  for  s*  e  S+ 

«0+)  -  P{^(*+)  s  £nJk(*+),  *  -  1,2 . *<*+)}  i  «. 

where  the  random  variable  Ak{s+)  has  distribution  F(  ;ek(s+j)  and  U|(s+),...^iJk(f+)(*+)l 
are  mutually  independent  and  independent  of  (£n  l(r+),...,£|Ijk(j*)(*+)). 

Then 


mir,)  -  *  «  »« 


F*»/:  Let  *+€  S+  tod  Lea*.  (A.6)  of  the  Appendix  *how«  thet 

*{*ajkk+*  +  *  K  *  RnjSs*)'  k  " 

j«rJ)  -  *+.  Kr.*)  -  vi-**11®*  -  *o}» 

(2.12)  *  «  F{*(7?)  “  '*•  “  Vl--J*rO>  “  *0*' 

Using  Equation  (2.12), 

/’{*(7;)  -  4  *(7-^)  -  Vt--^ro) "  xo) 

m  2  r{*lTn>  -  4  *<#)  -  ,+*  *T«-t>  “  Vi--JEW  •  V 

J+CS+ 

i  2  +  A»Jc^  iTt  +  ***(*+)'  k  “  1’2”"’*(,+) 

j*  ES* ' 

X(Tf)  -  s\  OT^)  -  Vi-  ^V  -  xo>* 

4  2  *  F{*(7?)  -  A  *(7*^)  -  "  *o} 

»*«** 

.  (  fl«r„.,)  -  vi  »•**  .aW  -  *<>}• 

It  fellows  that 

/•{Xtr,)  -  So\X{THml)„ ...  *  9  a.s. 

ml  Lemma  (2.8)  implies  that  P{X(TH)  ■  ig  i.o.}  »  1.  O 


Proposition  (2.13)  gives  a  set  of  conditions  on  the  building  blocks  of  a  gsmp  which 
ensure  that  tbs  process  is  regenerative  and  that  the  expected  time  between  regeneration 
points  is  Unite. 

(2.13)  PROPOSITION.  Let  IT^niO}  be  an  increasing  sequence  of  stopping  times  that 
are  finite  (7*a<«  a.s.)  state  transition  times  as  in  Equation  (2.10).  Suppose  that  there 
exists  «rSg£  5  and  t>0  such  that 

(2.14)  FpKr,)  -  ^  I  XlT+i)*-  M  W 

Also  suppose  that  for  i*eS’,  (i)  the  set  Oiatfa*  J)  ■  £Ug)ft  (£(**)-{**))  -  +,  (ii)  the  set 
Niseis’*)  m  N(s0;s,e*),  and  (iii)  the  dock  setting  distribution 
F(  ;sQ,e  S S)  ■  F(  ;s'0,e\s,e*)  for  all  V  €  AT(i fas  /).  Then  {X(f):f*0}  is  a  regenerative 
process  in  continuous  time.  Moreover,  if 

for  all  nzO  then  the  expected  time  between  regeneration  points  is  finite. 

Proof:  Using  Lemma  (2.8),  Equation  (2.14)  implies  that  event  e*  triggers  a  transition  to 
state  Jq  from  some  state  S*  infinitely  often  with  probability  one.  Furthermore,  at 
such  a  time  the  only  clocks  that  are  active  have  just  been  set  since  0(jj,;/,/)  -  e  for 
all  i‘es'.  The  joint  distribution  of  ^(r„)  and  the  clocks  set  at  time  7*„  depends  on  the 
past  history  of  (JK(r):*aO!  only  through  «q,  the  previous  state  /,  and  the  trigger  event  e*. 
Since  the  new  events  and  dock  setting  distributions  are  the  same  for  all  s*,  the  process 
{X0):*a0)  probabilistically  restarts  whenever  {X(ril):/ia0}  hits  state  *q. 

To  show  that  the  expected  time  between  regeneration  points  is  finite,  assume  for 
convssieacs  that  X \Tq)  -  2(0)  ■  j^.  Set  XH  ■  X(TJ  and  Dn  -  aaO.  Observe 


that  the  random  indices  fiH  such  that  -  2f(7^)  -  ^  form  a  sequence  of  regeneration 
pedate  for  the  process  this  follows  from  the  fact  that  the  process  (0R:it*l) 

starts  from  scratch  when  X(Tp)  -  s0.  Let  rk  -  Pk+i~Pk’  The  rk  are  i.i.d.  as  t,  and 
the  argument  in  the  proof  of  Lemma  4  in  [8]  shows  that 

/If,  >  «1  s  (1  -  «)" 

so  that  £{r|}<«a.  Thus  the  expected  time  between  regeneration  points  tor  the  process 
{(X’g'DjJmaO}  is  finite.  Since  £{rt}<«  and  Equation  (2.14)  ensures  that  tj  is  aperiodic, 
(Xn,Dn)+(X,D)  as  n-+m.  Using  the  continuous  mapping  theorem  we  have  Dn+D  as  n-*«* 
and,  since  0R*O  and  £{Dn}ic<«, 

£1 1 D 1 1  -  £{0}  a  Un  £{0.}  i  c  <  • 
by  Theorem  25.11  in  [2].  Since  i-j  is  aperiodic,  £{tj}<w,  and  £{  1 0 1  }<«, 


K  -I 


£|t,I 


so  that 


fs  "•( 


m 

]# 

be 


and  the  expected  time  between  regeneration  points  for  f£(r):/aO)  is  finite.  □ 


Note  that  the  state  transition  times  {rR:naO}  defined  by  Equation  (2.10)  are  necessarily 
stopping  times  if  for  all  *V  e  5 


(2.1S) 


f  ■»  whenever p(t"\s *)  > 0 and  e(s" ;«,**)  >  0. 


3.  BING  AND  BUS  NETWORK  MODELS 


The  following  example*  illustrate  the  use  of  the  osmp  model  as  a  formal 
specification  of  a  discrete-event  simulation  of  a  local  area  computer  network  and  the 
application  of  Propositions  (2.11)  and  (2.13).  These  results  are  also  applicable  to  the 
token  ring  and  collision-free  bus  network  models  in  Examples  (2.7)  and  (2.9)  of  [9]. 

(3.1)  EXAMPLE  (Token  ring).  Consider  a  unidirectional  ring  network  having  a  fixed 
number  of  ports,  labelled  1,2,...,N  in  the  direction  of  signal  propagation;  see  Figure  1.  At 
each  port  message  packets  arrive  according  to  a  random  process  and  queue  externally.  A 
single  control  token  (denoted  by  7  in  Figure  1)  circulates  around  the  ring  from  one  port  to 
the  next.  The  time  for  the  token  to  propagate  from  port  N  to  port  1  is  a  positive 
constant,  R#,  and  the  time  for  the  token  to  propagate  from  port  /-I  to  port  j  is  a  positive 
constant,  1* J  »  23.....N.  When  a  port  observes  the  token  and  there  is  a  packet  queued 
for  transmission,  the  port  converts  the  token  to  a  connector  (O  and  transmits  a  packet 
followed  by  the  token  pattern;  the  token  continues  to  propagate  if  there  is  no  packet 
queued  for  transmission.  By  destroying  the  connector  prefix  the  port  removes  the 
transmitted  packet  when  it  returns  around  the  ring.  Assume  that  the  time  for  port  j  to 
transmit  a  packet  is  a  positive  random  variable,  Lj,  with  finite  mean.  Also  assume  that 
packets  arrive  at  individual  ports  randomly  and  independently  of  each  other;  i.e.,  the  time 
from  end  of  transmission  by  port  j  until  the  arrival  of  the  next  packet  for  transmission  by 
port  J  is  a  positive  random  variable,  Aj,  with  finite  mean.  Note  that  there  is  at  most  one 
packet  queued  for  transmission  at  any  time  at  any  particular  port. 

Set 

(3  2)  XU)  -  (Z|(0*..tZj/f);M(f);M(j))t 


rV  V*  •  .fJVJV.  A 


•  V  V  v  *.■ 


z/0- 


1  If  there  it  a  packet  queued  for  transmission  at  port  J  at  time  r 
0  otherwise 


Nit)- 


j  if  port  j  it  transmitting  a  packet  at  time  r 
1  • 
0  if  no  port  is  transmitting  a  packet  at  time  t 


M<)  ■  1  if  at  time  t  port  N  is  transmitting  a  packet  or  the  token  is  propagating  to  port  1, 
and  MO  -  j  If  at  time  i  port  >1  is  transmitting  a  packet  or  the  token  is  propagating  to 

The  process  { AT(r)  :/201  defined  by  Equation  (3.2)  is  a  one  with  a  finite  state  space, 

5,  and  event  set,  E  -  {fj . where  #y+2  -  "observation  of  token,"  ry+1  -  "end  of 

transmission,"  and  tj  •  "arrival  of  packet  for  transmission  by  port  j,"  J  ■  1,2,. ...M  For 
s  ••  the  event  seta  E(i)  are  as  follows.  The  event  "end  of 

transmission"  C  £(s)  if  and  only  if  mX)  and  "observation  of  token"  £  E(s)  if  and  only  if 
mm  0.  The  event  "arrival  of  packet  for  transmission  by  port  /'  €  E(s)  if  and  only  if 
tj  m  0  and  m+j. 

If  e*»"end  of  transmission,"  then  the  state  transition  probability  p{s;s,e)  •  1  when 
»  m  +  1)  €  S  with  0<m<N  and  s'  •  +  1) 


i  -  Uv  jn;NA)€S  and  t  -  U,,  .^;0;1). 


If  e«"obeervation  of  token,"  then  pfs';s,r)  ■  l  when 

t  ■  (t|H»4l|.|,li^|^|r,>4jif!0ss)(  S  with  itKN  sad  f  ■  ♦  1), 


;0;N)£S  and  *  -  (x,,...,xjr.I,0;Ml), 


t  m  S  with  eOTand  »  «  {zir  'Zm.vOjn+l,..  ,zN;0;n  +  1), 


t  ■  (t|r«itj|^|iOsOsM)  end  v  ■  (i|,...^|t0;0;l). 


If  **"arrival  of  packet  for  transmission  by  port  theo  /(*';*,*)  ■  i  whoa 


i  -  ♦  1)€  5  with  and  OOiKAf 


*  «  ♦  1), 


r  -  (x1,...^/.,,0^/+1,...^;>r;l)C  5  with  N+j  mbA  s  -  (xlf...^,,l 1), 

and  when 

$  -  U|,...4y.|»0tZj4>|(...tzjy;0;n)  C  5  and  *  -  (x,,...tx^1,ltx^,,...,xjy;0;a). 

AH  other  state  transition  probabilities  pO';*,*)  are  equal  to  zero. 

The  distribution  functions  of  new  dock  times  for  events  t  cN{s;*f)  are  as 
follows.  If  r  •  "end  of  transmission"  and  t  -  (zlt...riN;m;n),  then  the  distribution 
function ^ «r' m)  ■  P(£msx).  If  •  "observation  of  token"  and  s'  -  (itr..,tx(e;s)l 
than  the  distribution  function  Ffc*V,M*)  ■  lp  |t-j(a)  If  n>l  and  equals  ljj^W  if 


t\ 


m  m  1.  If  g  m  arrival  of  paekat  for  tranamiaaion  bp  port  J”  than  tha  distribution 
function  #txuV  w)  -  fUytt}. 

As  an  appUcatioo  of  Propositions  (2.11)  and  (2.13),  taka  ^  -  (0,l,...,l;i;2).  Lat 
a*  ■  "observation  erf  token"  and  5*  -  i(z1,...^;0;l)e  5}  so  that  7*,  is  the  nth  time  at 
which  port  1  observes  tha  token,  naO.  Observe  that  r„<e  a.s.  since 

M 

(3.3)  £fr,  -  r^,!  a  it,  ♦  ...  ♦  Rn  +  £  <  • 

for  all  n*l. 


Lat  7^  be  the  first  time  after  ,  that  rim  token  leaves  port  Jf  so  that  l4,  »  S'*. 
For  r*  -(rJ',...^;m+;n+)«S+,  set  A*+)  -  (/»/(*♦)  -  0}  and  lat 
£♦(,♦).  |«,c  £:>«/(*+))  so  that  £*  -  Taka  *,*(«*>  -  (or  all 

*  >  lA...Jk(i+)  and  s*£S+.  Assume  that  the  dlstribatloo  of  A,  is  NBU  and  that 


ij-Htj*  *Ni  >0 


tat  jm  jf  so  that 


«(s+>-  n  v n 

j€At*)  Jml 

Than  Ptf( TJ  -  sp  i.o.}  -  1. 

A  transition  of  the  process  (XU):**0)  defined  bp  Equation  (3.2)  to  state  Sg  can 
occur  when  event  /  is  the  trigeer  event  onlp  if  r*  occurs  in  state  t *  -  (1,...., 1,0,1)  and  in 
tide  ease  the  set  Ofi^//)  -  *.  Since  Equation  (2.15)  holds  and  f  IXfr,)  *  *g  i.o.|  -  1, 
the  woo— No  tin—  Tm  at  which  r  triggers  a  transition  (in  state  /)  to  state  jg  are 
stopping  lid—  and  regeneration  points  tot  the  process  tX(j):r*0).  The  expected  than 


H 


••.v.v.v.v.v 


available  to 


•  smsc/MoS 

*  Wait  for  a  time  interval  !(/)  +  T 


•  Watt  until  tte  bus  is 


port  »  to  ba  Wa  AND  P(/)«0;  than  start 


of  tha  packet,  simultaneously  repotting  §(J) 


For  simplicity  we 


that  than  caa  ba  at 


port.  Specifically,  suppose  that  tha  time  from  cod  of 


arrival  of  a  next  packat  for  transmission  by  port,/ is  a  positive 


packet  in  queue  at  each 


by  port  J  until  tha 


variable,  Aj,  with 


finite 


■on.  Abo  suppose  that  the  time  for  port  J  to  transact  a  pocket  is  a  positive 
variable,  Lp  with  finite  moan  and  (so  that  Algorithm  A2  of  [S]  guarantees 
■don  of  all  packets)  such  that  A(l)  ♦  71  m  0.  * 


(3.5) 


Wit)  -  (  ^(0 . **</)), 


uhsrs  Wy(/)  vquals  1  if  at  time  t  port  ./has  set  its  flip-flop  but  has  not  yet  completed  the 
A(/>  ♦  T  watt,  equals  2  If  port  j  has  completed  the  R(J)  ♦  T  wait  but  has  not  started 
transmission,  equals  3  if  port  J  is  transmitting,  and  equals  4  otherwise.  Next  sat 


C3J) 


*  if  port  y 


m  -  (c/,w  gee'f  W>. 


transmission  of  a  packet  by  port  k  on  the  bus  at 


♦  . 
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<*7>  m  *  (^.,WiKj,c/).^j(<).fr4,|(d^..»v>y.1(0). 

•km  Vj^O)  equals  1  if  and  only  if  S(*)-l  at  tiina  t-MkJ),  and  equals  0  otherwise, 
(fort  J  observes  P0)*>1  at  tiaw  /  if  and  only  if  ^(z)  -  1  for  some  Finally,  sat 
ZW  -  I  if  soom  port  is  transmitting  ettirae  t  and  this  port  started  trsnsairsioo  when  it 
observed  an  and  of  traasaUsaioa;  otherwise  2(r)  -  0.  Than  sat 

(Mb 

The  stochastic  process  defined  by  Equation  (3.0  la  a  oasr  with  a  finite  state 

space,  St  and  event  sat,  E.  the  events  in  the  set  £  an:  "end  of  ttawnafaaioa  by  port  7," 
"Mod  of  wait  tar  £(/)  ♦  T”  "setting  (to  I)  of  flip-flop  by  port  y*  "observation  by  port  J 
of  start  of  tran—ialnri  by  port  **/."  "obaanratfoo  by  party  of  end  of  transmission  by 
port  k+J,"  "obsarvatlon  by  port  J  of  and  of  transmission  by  part  k+j  and  start  of 
transmission  by  port  l+j”  "obeenration  by  port,/ of  the  setting  (to  1)  at  flip-flop  by  port 
k  to  the  left,"  and  "observation  by  port  J  of  the  resetting  (to  0)  of  a  flip-flop  by  port  k  to 
the  left,"  Jm  1  £r..JN.  For  r  •  e  f  the  event  sets  £(s) 

an  as  follows.  The  event  nt  £(/)  contains  "setting  (to  1)  of  flip-flop  by  port  /  if  and 
only  tf  ay  •  4.  The  event  "end  of  tnnsmlssloo  by  port  y"  C  £(i)  if  and  only  If  wy  -  3. 
The  event  "end  of  wait  for  £(/)  ♦  T  c  £(s)  if  and  ooly  if  wj  -  1.  The  event  "observation 
by  port  y  of  start  of  transmission  by  port  *"<£(*)  if  and  only  if  (1)  -  3,  s  •  0,  and 

"j+k  or  (10  ■  3,  *  ■  1  and  either  Uj  »  0  or  uj  -  /  for  some  /  between  *  and  y.  The 

event  "observation  by  port  j  of  end  of  transmission  by  port  *"«  £(#)  if  and  only  if  *j  -  k 
mi  •  1  or 4  and  either  <»0  or  wj#3  for  all  /  between  y  and  k.  The  event 
"oftoatvnlltn  by  part  y  of  end  of  traasmissioo  by  port  h#y  and  start  of  transmission  by 
port  sad  only  if  uj  -  h,  s  *  1,  and  w,  -  3  with  /between  handy.  The  event 


"obsa ration  by  port  j  of  setting  of  flip-flop  by  port  it  to  the  left"  €  E(s)  if  and  only  if 
- 1  ud  vjj  -  0  for  torn*  k<J.  The  evut  "obeenrition  by  port  J  of  resetting  of 
flip-flop  by  port  k  to  the  left*1  e  E(s)  if  and  only  if  -  3  and  vJJt  -  1  for  some  k<j. 

Note  that  with  this  definition  of  the  event  sets  E{s)  no  "observation  by  port  j  of 
start  of  transmission  by  port  A"  and  "observation  by  port  J  of  end  of  transmission  by  port 
k”  can  occur  simultaneously.  To  see  this,  let  k<l<J.  Suppose  that  port  k  ends 
transmission  of  a  packet  at  time  t  and  that  port  /  starts  transmission  of  a  packet  at  time 
i  -  I  ♦  7t kj).  Then  the  event  "observation  by  port  j  of  end  of  transmission  by  port  k 
and  start  of  transmission  by  port  f  is  scheduled  at  time  i  and  (since  z  ■  1  and  w,  •  3 
where  /  is  between  k  and  J)  the  event  "observation  by  port  j  of  end  of  transmission  by 
port  k”  (which  was  scheduled  at  time  r)  ceases  to  be  scheduled  at  time  I. 

The  distribution  functions  of  new  clock  times  for  events  are  as 

follows.  If  e  -  "end  of  transmission  by  port  J,"  then  the  clock  setting  distribution 
function  -  F{Lj*x\.  If  e  -  "end  of  wait  for  R(J)  +  T,"  then  the  clock 

setting  distribution  function  F{x;s\t  ,s,*)  -  **  *  “  "setting  (to  1)  of 

flip-flop  by  port  then  the  clock  setting  distribution  function  F(x;s\t*j)  ■  P[Ajix). 
If  *  »  "observation  by  port  j  of  start  of  transmission  by  port  then  the  clock  setting 
distribution  function  /TxuV,M*)  •  “  "observation  by  port  j  of  end 

of  transmission  by  port  k”  then  the  clock  setting  distribution  function 
jS)  m  l(7^j)|M)(x).  If  •  -  "observation  by  port  j  of  end  of  transmission  by 
port  k  and  start  of  transmission  by  port  /,  then  the  clock  setting  distribution 
FOr,z  V ,zS)  m  If  *  -  "observation  by  port  j  of  setting  of  flip-flop  by  port 

k  to  the  toft,"  then  the  clock  setting  distribution  function  F(jwV'M*)  -  1  [*<*,/),.)(*)• 


P  » 


r*  ^ 
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ITi  •  "observation  by  port  J  of  resetting  of  flip-flop  bp  port  ft  to  tho  toft,”  then  tbo 
clock  sotting  distribution  function  F{ks  V  */)  - 

As  on  application  of  Propositions  (2.11)  and  (2.13),  taka 

Lot  /  -  "end  of  transaissioo  bp  part  1"  and 
S*  *  i(3»M|f.*w^x:lf...»l;v)C  5:vyj  -  0  for  j  -  2,3,...,Ar}  so  that  7,  is  the  nth  tins  at 
which  port  1  ends  transmission,  it* 0.  Then  port  1  ends  transmission  of  a  packet  with 
each  other  port  j  having  dbserved  the  resetting  of  port  l*s  flip-flop,  having  a  f*— 
queued  for  transmission,  and  having  completed  the  £(/)  +  7  wait  at  time  Tm  If 

X(7II)«4  Observe  that 

'  ,  i  >  '  >■ 

(3.»)  7.  -  7..,  -  ♦  £(1)  ♦  7  ♦  Dm  ♦  Lu, 

wham  Lu  is  distribttted  as  is  dtstHfcsted  a»4,,  and  D,  is  a  nonusgative  random 

variable.  Provided  that  the  distribution  of  Lj  is  W»U,  it  can  be  shown  that 

jr 

*U>.I  <  2*(U 

J-* 

so  that 

(3.10)  £17,  -  7^}  a  £M,|  ♦  £(1)  +7+2  *(M  <  - 

/-I 


Let  I?  be  the  first  time  after  7^,  that  port  1  begins  transmission  of  a  pocket  so 
•  that  S+  mf.  Let e/- "setting of  fUp-flep bp  port Pars4,  -  (^V/Jil*,  sot 
A»*)  -  yttf  -4|  oad  lot  #♦<*♦)  -  bycl^g***))  so  that  £♦  -  (s^..^).  Take 
Aolr4) m LfiMt) ♦  f)  far  aB  #♦«£♦  and  kelAJK*4).  Assume  that  the 


distribution  atdji*  NBU  and  that 


ij-r{Aj+ MD  +  TtLJXi, 

It  followsthat 

t  rn  t\Aj  ♦  X(l)  +  T*LltJm  2,3....,*}  >  0 


to  that 

«(*+)  -  r\Aj  ♦  A(i)  +  r<  lv  ja  A**)}  *  a. 

Then  mir,)  -  Lo.}  -  1. 

A  transition  of  the  process  (X(f):f*0)  defined  by  Equation  (3.8)  to  state  sQ  can 
occur'  when  event  /  it  the  trigger  event  only  if  /  occurs  in  state 

t  ■  (3,2....,2;Q;1,...,1;0,1 . 1)  and  in  tUt  cate  the  tet  0(jgsi  ■!  )  ■  Since  Equation 

(2.1S)  holds  and  F{X{TJ  «  i.o.}  •  l,  the  successive  timet  Tm  at  which  *  triggers  a 

transition  (in  state  i*)  to  state  ij,  are  stopping  timet  and  regeneration  points  for  the 
process  (X(<):raO).  The  expected  time  between  these  regeneration  points  is  finite  by 
Equation  (3.10). 


(3.11)  EXAMPLE  (Slotted  ring).  Consider  a  ring  network  having  a  fixed  number,  X,  of 
equal  tint  slots,  and  a  fixed  number  of  equally  sptced  ports,  labelled  1,2,...,*  in  the 
direction  of  signal  propagation;  see  Figure  3.  At  each  port  constant  (slot  size)  length 
message  packets  arrive  according  to  a  random  process  snd  queue  externally.  The 
propagation  delay  from  one  port  to  the  next  is  a  positive  constant,  X.  We  assume  that 
the  number  of  ports,  *,  is  a  multiple  of  X  and  (so  that  there  is  no  loss  of  utilization  due 
to  "unusud  bits")  that  the  time  to  transmit  a  message  packet  is  equal  to  *X/X.  The  lead 
"faH/emptf"  (F/D  bit  maintains  the  status  of  each  slot.  A  port  holds  a  slot  from  the 


time  that  it  begins  filling  the  slot  until  it  releases  the  slot.  Subject  to  the  restriction  that 
no  port  can  hold  more  than  one  slot  simultaneously,  a  port  that  has  a  packet  queued  for 
transmission  and  observes  the  status  bit  of  an  empty  slot  sets  the  bit  to  1  ("full")  and 
starts  transmission.  Transmission  ends  when  the  slot  contains  the  entire  packet.  When 
the  status  bit  of  the  filled  slot  propagates  back  to  the  sending  port,  it  resets  the  bit  to  0 
("empty")  and  releases  the  slot.  The  port  releases  the  slot  even  if  it  has  another  packet 
queued  for  transmission.  This  ensures  that  all  ports  have  an  opportunity  to  transmit. 
Assume  that  message  packets  arrive  at  individual  ports  randomly  and  independently  of 


“v-i1 .  ■Jys  <«'C' 


vector  facilitates  generation  of  the  proceu. 


The  proceM  {X(/):iaO}  defined  by  Equation  (3.12)  ia  a  gsmp  with  a  finite  state 
apece,  S,  and  event  set,  E.  The  evenU  in  the  set  E  are:  "observation  of  status  bits  by 
ports"  and  "arrival  of  packet  for  transmission  by  port  j,"  j  «■  1,2,...,M  Let 
*  ■  The  event  "observation  of  status  bits  by 

ports"  c  E(s)  for  all  seS.  The  event  "arrival  of  messsage  for  transmission  by  p^/t 
/'  £  E(j)  if  and  only  if  ij  « 0  and  for  each  i  either  (i)  m^j  or  (ii)  m fmj  and 
n,.-!  m  j~l  +  /  (mod  N)  for  some  integer  /  such  that  N/K<l*N.  Note  that  the  enda  of 
transmission  coincide  with  the  occurrence  of  particular  "observation  of  statua  bits  by 
ports"  events.  Suppose,  for  example,  that  there  are  N  —  4  ports  and  K  —  2  slots  and  that 
s  -  (0,0 ,0,0;  1,0; 3,1);  i.e.,  port  1  is  transmitting  a  packet  in  slot  1,  slot  2  is  empty,  the 
status  bit  of  port  1  is  propagating  to  port  3,  and  the  status  bit  of  slot  2  is  propagating  to 
port  1.  Then  the  occurrence  of  the  event  "observation  of  status  bits  by  ports"  in  state  s 
corresponds  to  an  end  of  transmission  by  port  1. 

In  a  slotted  ring  with  AT -  4  ports  and  K  -  2  slots,  take  Jq  -  (0,1,0,1;1,3;2,4).  Let 
t  -  "observation  of  status  bits  by  ports"  and  5*  *  {(21^r2^3^4;0,m2;l,3)£  5}  so  that  Tn 
is  the  nth  time  at  which  port  1  observes  the  status  bit  of  slot  1  and  slot  1  is  empty,  n*0. 
Suppose  that  the  distribution  of  Aj  is  NBU  and  that  P{Aj  <  A)  ■  1,  j  -  1,2,...^.  Then 
P{X(Tm)  ■  Jq)  ■  0  for  all  nil  if  *(0)  ■  (0,1,0, 1;0,3;2,4).  Using  arguments  similar  to 
those  in  the  proof  of  Proposition  (2.11)  it  can  be  shown  that  if  the  distribution,  Fj,  of  Aj 
is  NBU  and  F/h)-F/o)> 0  for  all  0sa<6<«,  then  P{X{T„)  -  sQ  i.o.)  -  1. 


<** «■.  »■; 


■«S»,  -t. 


Let  {JKU):#*Oj  he  a  owr  with  finite  state  space,  S ,  and  event  set,  £.  Recall  that  f„  is 
the  time  of  the  nth  state  transition  and  that  Sn  -  X({m)  is  the  state  of  the  system  at  time 
naO.  Also  recall  that  Cn  is  the  vector  of  clock  readings  at  time  and  that  is  the 
fth  coordinate  of  the  vector  Cm  few  e(€  £(£„).  Denote  by  £  -  /* (S^v  <Vi>  the  index  of 
the  nth  trigger  event  and  let  In  ■  £(£„)}. 

Let  ig^j 5  end  E  with  H‘k*sk- T^len  the  joint  event 

CA.l)  {^U»)  ■  V*«"  *ij’  W,.i)  ■  Vt* **  m  *^1’“'*  *1  "  *<"» "  *0} 

Is  equivalent  to  the  joint  event  specified  by  the  inequalities 


(42) 


CmJ*.  *  CmJ?  t€lm  ~  1 


in  conjunction  with  the  equations 


(A*) 


ik)  ■  k  ■  0,1,.. .^i. 


UImm  *C+lj- "  write  C  •  <• 


throughout  that  E(sq)  is  the  set  of  active  events  at  time  t  ■  0  and  that  all 


active  clocks  are  reset  at  time  i  -  0;  i.e., 


£{C0J  tx}>  F(x,i^A 

for  some  s,t€S  and  re  £  (dependent  on  0,  e(c  E(t^.  In  addition,  we  define 
MVfn.t<4  "  £(*o)  for  m  -  0. 


fWW 3 


Nut  observe  that  if  *(€  0(vVi*0  *° tlut  an  old  clock  reading,  than 

CmJ  "  CmJ  "  ^2 

where  {m  is  the  latest  time  prior  to  tn  at  which  the  clock  associated  with  event  ef  was  set. 
This  implies  that  any  old  clock  reading  ckJ  appearing  in  Equation  (A. 2)  can  be  expressed 
in  terms  of  one  or  more  Cmj  with  tje  and  mx*.  Replacing  in  this 

all  old  dock  readings  appearing  in  Equation  (A. 2)  by  expressiona  which  involve  only  new 
clock  readings,  we  obtain  an  equivalent  system  of  inequalities  which,  hi  conjunction  with 
Equation  (-4.3),  we  denote  by  We  call  the  canonical  rtp/vtctuatioa  of  the  joint 
event 

■  V  eH  m  ■  **.!»  <1^1  m  ^J**'**  *1  *  ^  *  *}. 

(-4.4)  LEMMA.  Let  such  that  *  »  1  £,...,/(«). 

Select  «if€  and  let 

•«  “  >  “  l'2 . •*«>!• 

Either  the  set  of  inequalities  (VN,  Va)  is  inconsistent  or  there  exists  such  that  (1) 

{•„.  J.)  and  {•„,  are  equivalent,  (ii)  no  random  variable  in  •„  appears  in  V., 
and  (ill)  the  random  variables  in  1H  are  mutually  independent. 

Proof:  For  fixed  k,  observe  that  the  variable  Cj^  appears  only  in  those  Inequalities  In 
f,  corresponding  to  state  transitions  at  times  tj  „■  There  are  two  cases  to 


Cast  0).  For  soma  k  ud&tUm-U  f„  contain*  the  inequalities 

«(<%*  -  2  C*c.,)  <  *<c<>  “  '«  •  «'»!• 

"»-A 

whn«  ¥(•)  denote*  an  expression  written  in  canonical  form.  By  the  structure  of  the 
this  means  that 

*<^,>-*(^.-2  c^  ,) 

mmJk 

which  implies  that 

**A 

and  contradicts  the  corresponding  inequality  in  Vr 
Case  (li).  For  every  *, 

M.S)  9(CU^  )  <  -  2  CnM*+l)’  *  “  ■Mk+1*’*""1- 

*■4 

This  is  equivalent  to 

«ffc4  +  **»«(**♦  A  C-i„)  ■  ^(fj+|)»  I  ■  /k«/,k+l »•••**"!• 

But  ekari|9  (for  mry  ft)  each  of  these  equations  is  implied  by  the  inequality 

* v  > 

which  is  an  element  of  Since  the  only  inequalities  in  f„  which  contain  the  rn 
variable  C ^  are  thorn  In  Equation  W.S),  the  required  subset  f„  Is  farmed  by  dal 
(for  each  A)  the  HmquaHtiea  in  Equation  Note  that  slnoo  the  only  Cq  varl 


Hi 


that  the  random  variables  in  9.  are  mutually  independent.  Q 

04.6)  LEMMA.  Lat  t*€S*  Mid  ^..^€5.  Under  the  conditions  of  Fropoeltion 

(2.11). 

*f*a*k*>  ♦4iafe+)a  T+  ♦ 

*0  • sir,.,)  «  jrtr,)  • 

k  t  ^{nif)  -  *♦.  nr^j) .  -  *}. 

Protf:  Sal 

u.  -  {*!*)  -  <.  nr*,)  -  v,--  «»i>  -  **} 

-itatUfc/.U  I  be  the  (coeatable)  aet  of  all  Joint  events  of  the  form 

*a  "  *  '/UjO*  fJhd  "  %*)*•"•  *1  *  #<f*  ^  *  *o}’ 

tjffjt)  ■  and  there  udat  seek  that  e,*  -  #*,  and 

<j#*  or  sh  j  jf  5*  for  all  /#/y  Alao  let  be  the  canonical  repreaentatioo  of  the 
went  V*m.  Next  cooridar  the  Joint  event 

{***(*♦)  ♦  A^t*)  <7j  +  *„*(#♦),  k  - 

V  *«*(**)  *  Jj.  then  the  vaenons  itataMant  {4^(*+)>0}  can  be  written  as 
♦  A^ (s+)  >  If  I-  If  .  than  S^is*)  ♦  since  A^s*) 

la  If  MHtfon  the  sleek  readies f«  •**  that  is  active  at  time  7*.  Thus,  the  Joint 

U.7)  ♦  A'jfr*)  <  If  ♦  *„*<*♦),  *  .  VJ 


*  K 


30 

nd 

(4.S)  {S«jk<*+>  +  ***('*>• 

>*?.*-  I  A~.H»+)sql| 

an  equivalent. 

Nov  observe  that  for  every  sequence  F*  of  states  and  trigger  events,  S„jk(i+)  corresponds 

*®  W*> ««»  to  some  tM.  Abo,  4(lJk<r*)  corresponds  to  sons 

wh*r*  corresponds  to  some 

f 

*<<Mjjk(j+).  Since  £/„  is  the  dbjoint  union  of  the  events  l£,  we  can  combine  the  above 
results  to  obtain 


f4.*>  '(SnjtO*)  *  4  -  u,...,*(r+);iy 


2  1  fflU)  "  W*) 


>  f/(M)  *  *«<.»*>•  *  “  l,2,...,*(f+);Bj(iIi.)}» 

when  all  terms  of  probaUlity  aero  an  excluded  from  the  sum.  By  Lemma  (4.4),  we  can 
replace  by  without  altering  the  value  of  the  sum. 

Setting 

JU+ M  JCU4M 

Z/0+)JMt)  “  *(*/U,*>  *  **MJk>)  “  *(  2  C/£,  '  2 


and  denoting  the  set  of  random  variables  appearing  in  the  canonteal  npreeantation 

•ftw  *  *««**•)  ^  ^4u)"f«uaP*  we  can  write 


Cm* m  h\  mMjfttk  tjUMUjLk)*  ^ 

U.MO  -  /^  ^PMMM9  *  Z/fc*WOUUdW  ♦  Vui* 
ciO**)MuUt)  y  ZjtitijM)to*  k  * 

vim  f|  sad  Fc  m  the  JototdtatriboUon  taaotkm*  of  ■  l^...JK*f)I 

and  *  - l*..JMa*)fe  wctlmly.  Usint  hypothaaia  (H)  of 

Proposition  (2.11)  sad  the  fact  that  the  random  variables 
k  m  do  not  appear  in  l«w  «*•* 

*  Zxu)^WJ»Jk)(e)  ♦  'Wj.U* 

cfu+jk)*u*jn  >  *  “  l  X-  .W*'*')  :•}«,*)(«)} 

■'  v  acn  "  "r,;  '■  ■  ■ 

-  n  [?tC<U**M«CUJ»  *  ZAfc«WuWe)  *  to 

*•1 

CKi**)Mt+Ji)  >  ZAUM(M*)<CH]  ^Wiji)<c)} 

Ht*) 

*  II  *  '«<<*>.*) 

*•1 

•  i*CcdiAa)m(iAft)  *  riv*)*' k  “  1’2»-’*(*+)| 

^KttiOlaftia)  >  ZXMWWwa)»  *  "  l^,.-^(j+);f5(<J|)(e)|. 

Uriag  hppllMh  (iii),  embatitattag  tha  right  hand  aide  into  Equation  (4.10)  and 


mUl  m  h\  *  tfajA  * 

C4.II)  cMto*/k*%  >tju*)  *  f«MJk>*  *  "  1  A*.  •**<*+)i*/u>«)}» 

* 1  ^{c«a*i^ku*)  >  f »j«)  mf*t**y k "  1^.-^(i+);^5(M)}- 

SMMtat  Squto  (4.11)  into  Equation  (4.9)  and  using  Lemma  Cd.4), 

*{4**^)  .♦  4**(s+)  <  It  *  4^+),  *  -  U..,Jk(f+);t/,J 
*  X  *  HcKij»Jt)MUtM  >  *M»)  '  SlO+M'  k  “  1  »2*-..^(e'*‘): 

l 

-  4  /{^(j^)  +  4(aC**)  »  7+.*  -  Ur~JC»4)i(Vl 

The  last  equality  follows  by  tha  same  reasoning  that  leads  to  the  equivalence  of  the 
events  in  Equations  (A. 7)  and  (4.S).  Q 
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